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I. INTRODUCTION 


In 1990, the marginal cost of training one pilot through the CAT II stage of his 
career ranges from a low of $394,000 for P-3 pilots to a high of $1,348,278 for F-14 
pilots (Morrissey, 1990).! This is a significant monetary investment in human capital that 
the Navy makes to ensure its pilots are as qualified as possible to perform their required 
duties. To protect this investment, the Navy strives to retain aviators beyond the 
completion of the minimum service requirement (MSR) incurred from flight training. MSR 
policies have traditionally been structured to ensure that the investment outlays for 
training aviators have been recovered by expiration of MSR. All officers incur an initial 
MSR upon their commissioning into the service. This obligated service commitment is 
generally four years from the date of commissioning. For some more technically 
specialized communities such as aviation and nuclear power, an additional commitment is 
incurred to compensate for the increased costs and extended time required for the 
specialized training. 

The obligated service incurred from flight training increased from five years from 
the completion of flight training or “winging” to six years in 1987, then to seven years for 


helicopter and propeller pilots and eight years for jet pilots in July 1988. Currently there is 


1 According to a March 1990 Economic Analysis Report titled 7he Cost of Pilot Training 
by Bill Morrissey and Steve Cylke, these figures include the cost of Undergraduate Flight 
Training, CAT I training which is usually a pilot’s first advanced training in a specific fleet 
aircraft and CAT II training which is refresher training for a pilot who has previous fleet 
experience (one tour or more) in that aircraft. 


a proposed increase to a maximum of nine years for the sub-community of jet pilots. These 
changes in obligated service commitments have resulted in aviators’ careers being 
lengthened to almost eleven years (when the approximately two years to complete flight 
training is factored in) before they are even eligible to voluntarily leave the service. This 
length of service in itself is a significant factor in predicting the accession behavior of 
individuals as the increases in obligated service tend to weigh heavily in the minds of 
young officers making the decision to enter the aviation career “pipeline” versus a shorter 
pipeline such as that of the surface warfare community. Once they have entered the 
aviation community pipeline, retention of these individuals becomes a primary concern of 
the Navy. 

The retention of Naval aviators has been studied for many years, probably since the 
advent of Naval aviation, but is still considered to be a ‘hot topic” among Navy policy 
makers. There are an inordinate number of factors that contribute to an aviator’s decision 
to remain in the service or to leave and seek employment in the civilian sector. Many of 
these factors are difficult to quantify as they deal with ‘gut feelings” and human behavioral 
factors. This thesis will quantitatively examine several institutional and non-institutional 
factors that may have contributed to recent changes in aviator retention in the United 
States Navy. The primary research question it will seek to answer is, “What have been the 
separate impacts of various institutional and non-institutional factors on the retention of 


naval aviators between 1990 and 1997?” Subsidiary questions include: 


1) Can we build a simulation model that can be used to predict future behavior 
by reproducing similar scenarios based on past events and behaviors? 

2) What caused an unexpected ‘Spike’ in the pilot cumulative retention rate 
(CCR) for FY96? 

3) What caused the upward trend in pilot CCR for years of service 3 through 12 
from FY95 through FY97 while the rates for other officer communities 
remained basically constant? 

4) Which institutional factors have significantly contributed to recent changes in 
aviator retention? For example, have recent changes in MSR policies 
contributed to an increase in aviator continuation rates? 

5) Which non-institutional factors (such as changes in civilian employment 
Opportunities) have significantly contributed to recent changes in aviator 
retention? 

The answers to these questions will provide valuable insights into the retention 
behavior of individuals and will allow policy makers and officer community planners to 
structure future decisions based on quantifiable results. 

The plan of this thesis 1s as follows: Chapters II and III provide background 
information and a comprehensive review of literature pertinent to this study. Chapter IV 
discusses the data and methodology used in this study. Chapter V analyzes the data and 
presents results of a statistical model constructed to predict future behavior. The final 


chapter will provide conclusions and recommendations drawn from the study. 


Scope of Thesis 


This thesis will focus only on the “pilot” community of aviators. Past studies have 
shown that the retention behavior of naval flight officers (NFOs) differs significantly from 
that of pilots due to factors such as available job opportunities in the airline industry and 
the relative effects of incentive programs such as aviation continuation pay (ACP) and 
variable separation incentive (VSI). The thesis will analyze pilot retention/continuation 
behavior between 1990 and 1997 and examine the effects of several different institutional 
and non-institutional factors on that behavior. It will focus on the career period at which 
the initial MSR 1s fulfilled because that is considered the most critical point at which 
retention can still be controlled to a certain extent by policies and programs. After this 
point, retirement benefits become the primary incentive motivating retention. 

Data for this thesis will be cultivated from the Officer Master File through the 
Officer Personnel Information System (PC-OPIS). OPIS provides historical aggregate 
officer retention/continuation behavior. The data from this source originate in Bureau of 
Personnel (BUPERS) Officer Personnel Records, which are then screened and 
summarized by Naval Personnel Research and Development Center’s (NPRDC) ‘FAIM- 
OQ” system, converted into OPIS III input files, and finally converted into PC-OPIS input 
files. These files are accessible through the Highlander data query software. Cohort data 
constructed from this database will be used to examine the effects of several different 
variables on retention rates. These variables will include institutional factors such as 


commissioning source, aviation qualification designator (AQD), and MSR policies while 


the non-institutional factors will include various economic factors such as monetary 
bonuses (like ACP), national unemployment rates, and civilian job opportunities. These 
factors were chosen because airline hiring rates, airline pay and total unemployment have 
been proven to be the primary factors affecting retention behavior of Naval aviators 
(Cymrot, 1989). Once all of the significant factors have been analyzed, a simple Excel 
simulation model will be constructed in an attempt to reproduce certain scenarios and 


predict future behavior. 





Il. BACKGROUND 


Currently, analysts use historical retention behavior to predict future behavior. 
There are several different methods one can use to measure this historical retention 
behavior but the most appropriate aggregate retention method is generally considered to 
be the one that most accurately predicts observed future behavior. Historical continuation 
rates provide insight into the behavior of officers at different points in their careers while 
cumulative rates summarize the past experience of a group of officers, which is often a 
critical determinant of future behavior (Mackin, 1996). Three alternative retention 
measures are most commonly used by personnel analysts and planners. These alternatives 
include MSR survival rates, spot continuation rates, and cumulative continuation rates 
(CCRs). 

The first type of retention measure studied is the analysis of MSR survival rates. 
This measure takes an inventory of officers in a specific year group two years after the 
completion of their MSR divided by the inventory one year before the completion of 
MSR. This is done because this period typically encompasses the time when the largest 
number of voluntary losses occur. This rate 1s useful in that time-series variation in the 
MSR survival rates gives analysts some indication of the availability of officers for future 
years. These rates are most susceptible to policy changes that are intended to induce short- 
term changes in retention behavior. Examples of these policy changes include aviation 
continuation pays (ACP) and variable separation incentives (VSI) that target specific 


subgroups with monetary incentives in order to either increase or decrease retention. 


Previous studies have been conducted to determine the actual effects of these policy 
changes. 

Spot continuation rates are simply the number of officers in a year group who 
were on active duty on the last day of the fiscal year divided by the number of officers in 
the same year group on active duty on the first day of that fiscal year. This definition 
makes the assumption that the retention rate will include net lateral transfers because if it 
excludes these lateral transfers, the rate would be the proportion of officers who were on 
active duty on the first day of the fiscal year who were still on active duty on the last day 
of the fiscal year (Mackin, 1996). Tables 2.la through 2.1f summarize the spot 
continuation rates computed for each separate pilot community from 1992 through 1997. 
For example, Table 2.1a shows the beginning and ending inventories for all 131X (pilot) 
designated officers (net of lateral transfers) for year groups 1960 through 1991 as of the 
final day of that fiscal year, September 30, 1992. Because these inventories are ‘net of 
lateral transfers’, the ending inventories of one year do not always match the beginning 
inventories of the next year. Dividing the ending inventory by the beginning inventory, the 
spot continuation rate is derived and shown in column 3 of the table. For example, for 
year group 1991, dividing 79 by 80 yields 98.75%. The continuation rates (CR’s) for years 
six through eleven and three through twelve are computed as the sum of the end 
inventories in those specific years divided by the sum of the beginning inventories for 


those same year groups. These CR’s are also displayed in Tables 2.1a through 2.1f. 


Table 2. la. 
FY 1992 Pilot Continuation Rates 


YEAR GROUP BEGIN FY INVENTORY END INVENTORY CONTINUATION RATE 


98.75% 
99.17% 
98.07% 
9753976 
95.24% 
91.30% 
80.82% 
74.39% 
IIA 
939576 
79.90% 
94.42% 
96.19% 
94.83% 
93.88% 
90.05% 
96.85% 
99.03% 
90.77% 
69.70% 
77.69% 
78.17% 
81.07% 
83.61% 
70.71% 
64.84% 
58.70% 
81.82% 
80.00% 
35.71% 
14.29% 
0.00% 





3 YRS -12 YRS CR 89.60 
(YG 80 - 89) CCR 27.87 
6 YRS -11 YRS CR 84.40 
(YG 81 - 86) CCR S222 Source: PERS 233 


Table 2. 1b. 
FY 1993 Pilot Continuation Rates 


YEAR GROUP BEGIN FY INVENTORY END INVENTORY CONTINUATION RATE 


97.30% 
97.25% 
99.12% 
97.33% 
94.60% 
94.30% 
86.74% 
79.39% 
85.51% 
92.21% 
82.96% 
89.72% 
93.95% 
97.36% 
97.71% 
97.02% 
99.02% 
97.35% 
87.54% 
71.12% 
77.36% 
89.32% 
89.29% 
81.62% 
81.37% 
74.00% 
66.10% 
74.07% 
66.67% 
30.00% 
20.00% 
0.00% 





3 YRS - 12 YRS CR 90.60 
(YG 81 - 90) CCR 34.63 
6 YRS -11 YRS CR 87.20 
(YG 82 - 87) CCR 42.32 Source: PERS 233 


10 


Table 2. lc. 
FY 1994 Pilot Continuation Rates 


YEAR GROUP BEGIN FY INVENTORY END INVENTORY CONTINUATION RATE 


100.00% 
96.38% 
96.28% 
95.01% 
90.10% 
91.71% 
88.98% 
78.94% 
83.11% 
88.22% 
85.03% 
91.33% 
96.91% 
97.03% 
95.93% 
16.89% 
77.19% 
69.46% 
75.77% 
68.16% 
77.91% 
73.98% 
76.09% 
78.22% 
62.50% 
59.04% 
55.41% 
41.03% 
85.00% 
44.44% 
16.67% 
0.00% 





3 YRS - 12 YRS CR 88.30 
(YG 82 - 91) CCR 30.09 
6 YRS - 11 YRS CR 85.80 
(YG 83 - 88) CCR 40.07 Source: PERS 233 


Table 2. 1d. 
FY 1995 Pilot Continuation Rates 


YEAR GROUP BEGIN FY INVENTORY END INVENTORY CONTINUATION RATE 


90.00% 
96.30% 
98.78% 
96.48% 
97.72% 
2 Pais iii 
90.04% 
78.21% 
73.54% 
85.01% 
85.50% 
85.37% 
97.45% 
98.94% 
96.92% 
87.79% 
95.73% 
93.75% 
87.94% 
66.50% 
67.58% 
80.77% 
89.01% 
65.71% 
59.49% 
61.43% 
51.02% 
65.85% 
37.50% 
17.65% 
25.00% 
100.00% 





3 YRS - 12 YRS CR 87.60 
(YG 83 - 92) CCR 27.66 
6 YRS -11 YRS CR 84.00 
(YG 84 - 89) CCR 34.88 Source: PERS 233 
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Table 2. le. 
FY 1996 Pilot Continuation Rates 


YEAR GROUP BEGIN FY INVENTORY END INVENTORY CONTINUATION RATE 


100.00% 
100.00% 
98.72% 
99.06% 
98.30% 
97.17% 
92 95 76 
84.96% 
83.08% 
86.93% 
81.37% 
75.23% 
97.61% 
97.15% 
96.01% 
78.31% 
85.71% 
98.72% 
95.15% 
81.45% 
84.85% 
92.86% 
89.92% 
75.00% 
87.27% 
78.57% 
68.75% 
67.86% 
80.00% 
42.86% 
0.00% 
0.00% 





3 YRS - 12 YRS CR 90.40 
(YG 84 - 93) CCR 32.43 
6 YRS -11 YRS CR 88.70 
(YG 85 - 90) CCR 44.90 Source: PERS 233 
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Table 2.1f. 
FY 1997 Pilot Continuation Rates 


YEAR GROUP BEGIN FY INVENTORY END INVENTORY CONTINUATION RATE 
0.00% 
100.00% 
100.00% 
98.58% 
98.93% 
97.25% 
96.01% 
86.97% 
74.78% 
82.31% 
80.46% 
91.96% 
99.39% 
95.59% 
98.08% 
92.05% 
89.93% 
98.77% 
96.73% 
80.25% 
87.13% 
88.39% 
94.21% 
84.11% 
86.36% 
87.50% 
88.64% 
67.65% 
78.95% 
4.17% 
33.33% 
0.00% 





3 YRS - 12 YRS CR 90.00 
(YG 85 - 94) CCR 35.88 
6 YRS - 11 YRS CR 87.20 
(YG 86 - 91) CCR 40.08 Source: PERS 233 
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The third alternative retention measure that is most commonly used 1s the 
cumulative continuation rate or CCR. It is also shown in Tables 2.1a through 2.1f. CCRs 
are the product of spot continuation rates for a specific length of service (LOS). These 
LOS’s typically encompass LOS six through eleven or three through twelve because those 
specific time periods incorporate the effects of recent events and policies affecting 
retention across a fairly wide band of LOSs and are easy to compute from current 
continuation data (Mackin, 1996). 

Figure 2.la presents a graphic illustration of the CCRs for the pilot community 
from fiscal years 1990 (FY90) through 1997 (FY97). This can be compared to Figures 
2.1b and 2.1c that present the CCR’s for the same time period for the unrestricted line 
(URL) and the entire officer community. The graphical pattern of CCRs revealed a “Spike” 
or abnormal increase of more than 10 percentage points in FY96. This increase was 
common throughout the ALNAV and URL communities, but was especially pronounced 
in the pilot communities. Because pilots comprise approximately 60 percent of the URL 
and approximately 25 percent of ALNAV, these results may be biased towards artificially 
high CCRs. Without pilots included, there would most likely be less of a “Spike” in the 
URL and ALNAV graphs. For pilots, the CCR for years of service (YOS) six through 
eleven increased from 34.9 percent in FY95 to 44.9 percent in FY96 and then back down 
to 40.1 percent in FY97. The CCR for YOS three through twelve basically stayed the 
same for the ALNAV and URL communities from FY96 to FY97 but appears to have 


continued to rise in the pilot community. 
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One simple explanation for this trend would attribute it to recent changes in MSR 
policies that have increased the obligated service commitment for aviators. Unfortunately, 
this simple explanation may not be sufficient to explain the recent fluctuations in retention 
behavior. In order to clarify this problem, cumulative continuation rates must be 
decomposed to differentiate between those individuals eligible to leave the Navy and those 
still under some form of commitment and thus not eligible to leave. Naval Personnel 
Research and Development Center (NPRDC) analysts developed an algorithm to predict 
an end-of-obligated-service (EAOS) date for officers that would have been useful in 
determining the eligibility of individuals to leave the service. Unfortunately, the results of 
implementing this algorithm were less than satisfactory for econometric estimation 
purposes (Mackin, 1996). The most straightforward way to actually determine the 


eligibility of individuals to voluntarily leave is also time consuming and inefficient. Each 


eae 


individual officer record must be examined on a case-by-case basis to determine whether 
or not that individual is still under his initial MSR obligation or under some form of 
additional obligated service commitment that may have been incurred because of the 
receipt of ACP (the ‘bonus’), Test Pilot School, Naval Postgraduate School, War College 

or any other activity that may incur additional obligated service. This process would 
resolve the differences in individuals eligible to leave the service from those not yet eligible 
to leave the service and would provide a much more concise analysis of retention rates. 
Once these two categories of individuals have been identified, an analysis of various 
institutional and non-institutional factors can be conducted to explain and predict 
voluntary retention decisions. 

Tables 2.2a through 2.2) provide the retention statistics as of November 20, 1997 
for year groups 1987 through 1990 computed on a case-by-case basis and broken down 
into the original inventory of pilots and then further into the specific status of the cohort 
members of each aviation community. Each table provides the number of officers who 
have resigned their commission as well as those who have once failed to select (FOS) for 
Lieutenant Commander which traditionally indicates that they will most likely not select 
the next time around and thus should be considered with those leaving the service, 
although involuntarily. It also delineates how many individuals are at a decision point, how 
many have received the “bonus”, and how many have incurred an additional commitment 
from Test Pilot School (TPS), Naval Postgraduate School (NPS), or any of the war 


colleges. Finally it provides the number of individuals who are still under their initial MSR 
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obligation. The total number of individuals at their decision point, recerving the bonus or 
under a commitment incurred from TPS, NPS or war college is then divided by the total 
number of individuals in the year group excluding those individuals still under their MSR 
commitment and thus not eligible to leave the service. For example, looking at Table 2.2a 
for year group 1987, the total eligible to leave the service or under a voluntary 
commitment, 47, is divided by 81 (85 originally in the cohort minus 4 still under initial 
MSR) resulting in a 58 percent retention rate. Although there is no ‘perfect” measure of 
officer retention, this tedious process produces a retention statistic that includes only those 
individuals eligible to make the stay or leave decision which clearly links the statistic to the 
underlying behavior of the individual examined by separating iis choosing to leave from 


those choosing to stay. 
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Table 2.24. 


Retention Statistics for VFA Pilots Year Groups 87-90 
As of 20 November 1997 


VFA 

TOTAL 
RESIGNATIONS 
1X FOS's 


DECISION POINT 
BONUS RECIPIENTS 
TPS/NPS/WAR COLL 


Total YG - MSR 
RETENTION % 





Table 2.2b. 


Retention Statistics for VS Pilots Year Groups 87-90 
As of 20 November 1997 


VS - PILOT 
TOTAL 
RESIGNATIONS 
1X FOS's 


DECISION POINT 
BONUS RECIPIENTS 
TPS/NPS/WAR COLL 


Total YG - MSR 
RETENTION % 
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Table 2.2c. 


Retention Statistics for VP Pilots Year Groups 87-90 
As of 20 November 1997 


RESIGNATIONS 
1 X FOS's 


DECISION POINT 
BONUS RECIPIENTS 
TPS/NPS/WAR COLL 


Total YG - MSR 
RETENTION % 





Table 2.2d. 


Retention Statistics for HSL Pilots Year Groups 87-90 
As of 20 November 1997 


RESIGNATIONS 
1 X FOS's 


DECISION POINT 
BONUS RECIPIENTS 
TPS/NPS/WAR COLL 


RETENTION % 
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Table 2.2e. 


Retention Statistics for HS Pilots Year Groups 87-90 
As of 20 November 1997 


BONUS RECIPIENTS 


TPS/NPS/WAR COLL 


RETENTION % 





Table 2.2f. 


Retention Statistics for HM Pilots Year Groups 87-90 
As of 20 November 1997 


RESIGNATIONS 
1 X FOS's 


DECISION POINT 
BONUS RECIPIENTS 


TPS/NPS/WAR COLL 


Total YG- MSR 
RETENTION % 
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Table 2.2g. 


Retention Statistics for HC Pilots Year Groups 87-90 
As of 20 November 1997 


DECISION POINT 
BONUS RECIPIENTS 


TPS/NPS/WAR COLL 


Total YG- MSR 
RETENTION % 





Table 2.2h. 


Retention Statistics for VF Pilots Year Groups 87-90 
As of 20 November 1997 


RESIGNATIONS 
1 X FOS's 


DECISION POINT 
BONUS RECIPIENTS 


TPS/NPS/WAR COLL 


Total YG- MSR 
RETENTION % 





Zs 


Table 2.21. 


Retention Statistics for VAQ Pilots Year Groups 87-90 
As of 20 November 1997 


RESIGNATIONS 
1 X FOS's 


DECISION POINT 
BONUS RECIPIENTS 
TPS/NPS/WAR COLL 


RETENTION % 





Table 2.2). 


Retention Statistics for VAW Pilots Year Groups 87-90 
As of 20 November 1997 


RESIGNATIONS 
1X FOS's 


DECISION POINT 
BONUS RECIPIENTS 
TPS/NPS/WAR COLL 


Total YG- MSR 
RETENTION % 
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Ii]. LITERATURE REVIEW 


Since the advent of Naval aviation, retention has been studied, analyzed and 
examined in almost every possible way. A comprehensive review of pertinent literature has 
revealed that several issues are recurrent throughout aviation history and that decision 
makers and policy analysts have wrestled with these specific issues repeatedly. A majority 
of the studies attempt to quantify various aspects of an aviator’s career in the hope that 
they can pinpoint primary causes of increases and decreases in retention rates and target 
specific policies to address such problems. 

A 1965 study titled Pilot Shortages Ahead? An Examination of the Compensation 
of Career Military Pilots as Contrasted to Commercial Aviation Airline Pilots (Howard, 
1965) is as relevant to today’s aviators as it was more than thirty years ago. This study 
compared the compensation of military pilots to their contemporaries employed by civilian 
air carriers. It examines pilot manpower requirements in commercial aviation as well as 
estimates of future trends of such requirements in the industry. The study discusses ‘Vast 
sums of money spent recruiting, selecting and training men possessing the required 
qualifications” as well as the importance of retaining these individuals on a career basis. 
One of the primary factors considered then (and today) is money and the “utility” of pay to 
a particular individual. The author theorized that this utility should be comparable to what 
a military aviator might receive in the civilian industry. The civilian industry most logically 
and practically comparable to a military aviation career is that of a commercial pilot for 


one of the nation’s (or world’s) many airlines. The author draws many parallels between 
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the two careers and makes the assumption that the inconveniences and interruptions to a 
military aviator’s home and family life are not worth examining because it is believed that 
a ‘typical” airline pilot spends as much time “on the road” away from home and works just 
as ‘odd” working hours as a ‘typical” military pilot does. This assumption may be 
excessively simplified in that the two careers are not as similar as the author assumes, and 
if he had not made this assumption his results may have been different. 

Another similarity of this study to today’s retention problem is that civilian airlines 
at that time were in a similar bind in that there was a shortage of trained pilots due to the 
aging of their inventory and reduced inflows of trained military pilots. This is also 
occurring today as mandatory retirement ages are currently forcing the retirement of 
‘Vietnam Era” military pilots who left the military service after the war to pursue 
commercial aviation careers. This reduction in inventory coupled with recent downsizing 
policies that have reduced the number of pilots being trained by the military have led to a 
limited current supply of trained aviators similar to that experienced around the time of 
this study. The decrease in supply is worsened by the growth in the airline industry as a 
whole. This shortage of trained pilots 1s not solely due to aviator retention issues as the 
author points out that only a small percentage of the military trained pilots separating from 
the services in the ‘under 35” age group apply for or are apparently interested in pursuing 
a career as a professional pilot in any segment of the aviation industry. Nonetheless, the 
author concludes that based solely on comparative compensation, the military pilot 


completing his first tour of obligated duty would be considerably better off if he followed 
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the career of a commercial pilot. With the resources the military has today compared to 
the resources of the airline industry for compensating its pilots, it is clear to see that this 
problem is still evident today and probably will be in the future. It is the goal of policy and 
decision makers to find other means of reducing the civilian-military compensation 
differential in order to reduce military aviator loss. 

A recent Navy Times article echoes the issues brought out more than thirty years 
ago. In ‘Can the Navy Stop the Flow of Departing Officers?” (15 December 1997), the 
head of Naval Aviation, RADM McGinn, states that ‘improving aviator’s professional and 
personal quality of life is the absolutely top, number one, naval aviation issue.” He 
recognizes that the airlines are looking for pilots and the quality of professional life for a 
naval aviator is diminished by reduced flight hours, shore duty jobs that still keep aviators 
away from families, spare parts shortages and a flight pay structure that can leave 
squadron commanders earning less than their junior officers. These issues combined with 
the ‘Post-Tailhook culture shock”, post-drawdown turbulence and resource-requirements 
imbalances, have fueled discontent and led aviators to state that ‘ready rooms and flight 
lines just aren’t as much fun as they used to be.” To counter these problems, RADM 
McGinn has cited the increase in ACP (as of October 1,1997) up to a maximum allowable 
annual disbursement of $25,000 (from $12,000), an increase in aviation career incentive 
pay (ACIP) (as of January 1, 1999) to a maximum monthly disbursement of $840 (from 
$650), and efforts to reduce time away from home between deployments. Whether or not 


these changes will have a significant impact on aviator retention remains to be seen. The 
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important issue is that retention is a viable concern for policy makers and ongoing study of 
factors affecting it is a necessity. 

One study that attempted to examine causes and predict retention rates was Naval 
Aviator Retention: Predicting Retention and Identifying Related Variables (Cook, 1979). 
Although this study 1s almost twenty years old, it takes a unique approach to analyzing the 
subject. This study used the Navy’s Human Resource Management (HRM) and Navy 
Aviation Career (NAC) surveys to attempt to predict naval aviator retention six to 
eighteen months in the future. Through these surveys the author hoped to examine specific 
variables that discriminate “careerists” from ‘tesignees” in order to gain a better 
understanding of retention behavior and allow the Navy to develop effective action plans 
aimed at solving aviator retention problems. Results from this study correctly classified 
90% of the naval aviator sample into the two groups - careerist or resignee. It proved that 
attitude measures concerning command climate and general satisfaction were found to be 
highly correlated with personnel retention and that with the addition of several new items, 
the HRM survey could effectively predict the retention behavior of aviators. 

A problem with this approach was that it used “Stated career intentions” as the 
dependent variable which may tend to bias the results more towards the ‘politically 
correct” responses of what their superiors ‘Want to hear." This problem could have been 
eliminated entirely with a totally anonymous survey but, unfortunately, the surveys 
contained social security numbers that were used to track the individuals longitudinally 


throughout their careers. Although the results were not supposed to be seen by the 
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immediate chain of command, there was probably still a slight bias in respondents’ 
candidness. The study also discarded “undecided” individuals who may have provided 
insight and variation into the overall results of the study. One interesting fact that was 
presented was that at the time of the survey, 55% of the United States Naval Academy 
(USNA) graduates were careerists while only 22% were resignees. Of aviators from the 
Aviation Officer Candidate (AOC) program, the results were almost identical in that 55% 
were careerists and 25% were resignees. This contradicted a previous study conducted by 
Rickus, Booth and Ambler (1968) that had indicated that of USNA graduates, 70% were 
careerists and of AOCs, 41% were careerists. This pattern also will be explored in this 
thesis as commissioning source will be evaluated as to the effect it has on retention. 
Another study that is as relevant today as it was almost twenty years ago is A 
General Retention Model Applied to the Naval Aviator (O’Donnell, 1980). This study 
presents both a general retention model and a specific model applicable to the naval 
aviator that are based on various factors affecting job satisfaction. These factors are 
derived from work attitudes and perceptions of an individual about an organization that 
can influence the individual’s decision to stay or leave. These factors in themselves may be 
shaped by many other factors which may in turn influence turnover and retention. The 
results of the model led the author to recommend actions that would satisfy the sociologist 
Herzberg’s ‘hygiene factors” or Maslow’s ‘lower order needs” first before moving on to 
more advanced needs. This approach can be restated in current terms by saying that it is 


first and foremost important to satisfy “quality of life” issues when dealing with job 
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satisfaction before moving on to higher level needs and non-hygiene factors. This appears 
to be essentially RADM McGinn’s approach to attacking the naval aviator retention 
problem. 

As previously discussed, many studies have attempted to quantify variables that 
have a significant impact on aviator retention. One such study is A Statistical Analysis of 
the Effects of Flight Time on Naval Aviator Retention (Lawry, 1993). This study 
quantified the relationship between flight time and retention while controlling for the 
effects of civilian airline pay and hiring levels as well as the effects of marital status, 
children and race. Although Lawry’s a priori hypothesis was that aviators often leave due 
to a lack of flight time, he found just the opposite: that retention was inversely related to 
flight time in the jet and propeller aircraft communities. The effect of flight time for 
helicopter pilots was not found to be statistically significant. 

Lawry discounted the use of aviator survey data, probably because it is sometimes 
difficult to quantify. He also discussed annualized cost of leaving (ACOL) models that 
base the stay or leave decision on perceived future costs and benefits of each alternative. 
They factor in monetary components incorporating total expected pay and benefits for 
both military and civilian employment and account for a ‘utility’ function that measures 
personal taste or distaste for military life. The specific model Lawry used included 
variables such as flight time, average annual starting salary for major airlines (lagged one 
year), number of pilots hired by the airlines (lagged one year), marital status, whether or 


not the individual has children, and race. 
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On a broader scale, some studies attempted to determine the effect of a wider 
range of variables on retention. The Impact of the Military Drawdown on USN Aviator 
Retention Rates (Turner, 1995) uses a unique database that takes grouped data defined by 
year of commission, fiscal year, and aviator type and quantifies the relationships between 
various downsizing policies and cohort continuation rates while controlling for the effects 
of time-since-minimum service requirement (MSR) and civilian employment opportunities. 
Turner’s research examines downsizing policies such as VSI/SSB and involuntary 
reduction in active duty (IRAD) programs that are intended to reduce retention rates 
below what they normally would have been. These programs tend to distort the underlying 
trend in “voluntary” retention that is of primary concern to decision makers. 

Turner’s study reveals that downsizing policies have had only a minor effect on the 
underlying, baseline continuation rates. He did find that there was a statistically significant 
positive relationship between an increase in the amount of ACP bonuses and the 
continuation rate but the downsizing policies such as VSI/SSB and IRAD did not appear 
to be statistically significant suggesting that the policies were not as effective as policy 
makers had hoped. This type of analysis can be very useful to decision makers as they can 
now quantify effects of various policies and target specific aspects of the policies to 
increase or decrease desired retention rates. It also substantiated the recurring theory that 
increases in monetary compensation do have a significant positive impact on aviator 


retention rates. 
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Because monetary compensation policies and programs have proven to be 
successful in increasing retention, analysts have spent a great deal of time studying these 
programs. One of the most significant of these programs 1s ACP. In /mplementation of the 
ACP Program (Cymrot, 1989), the policy’s history is traced to its beginnings. In January 
1989, ACP replaced the Aviation Officer Continuation Pay (AOCP) program as the 
Navy’s major compensation tool for retaining mid-grade aviators. ACIP is another tool 
that 1s used that affects not just mid-grade, but all aviators. The ACP program was created 
in response to a critical shortage of Lieutenant Commanders to fill “Category II” billets as 
department heads or officers-in-charge in aviation squadrons. The program was developed 
in response to unusually high loss rates between the time aviators complete their active 
duty service obligation (MSR) and the time they serve in a specific CAT II aviator billet. 
The previous program, AOCP, had provided desired results by reducing shortages in the 
past but program and budgetary limitations prevented the program from eliminating the 
shortages in the current environment. To compensate for that inadequacy, in-depth 
analysis was conducted to shape the size of the bonus as a function of the size of the 
specific sub-community shortage. An implementation plan (as well as alternative plans) 
was also devised to ensure the program was compatible with budgetary limitations. This 
policy was successful to a certain extent, but appears to have rested on its laurels for too 
long and has not changed with time or changes in related policies. 

In 1997, a study was conducted to evaluate the status of the ACP program. ACP: 


Should the Maximum Award Be Increased? (Moore, 1997) evaluated the ACP program 
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and to no one’s surprise found the program to be outdated. The maximum bonus award 
was not yielding desired increases in continuation rates in some aviation sub-communities 
and planners were anticipating future shortfalls as the smaller “drawdown era” year groups 
approached their MSRs. The actual value of the monetary reward for the ACP program 
was found to be underestimated by 38 percent due to a combination of price inflation and 
increases in service obligations for YG 87 and later. 

Moore also analyzed the inadequacies of the ACIP program. For example, the 
program was not structured to follow current career paths so that the higher amounts of 
ACIP were paid solely to aviators at the end of their obligated service. Paying ACIP to 
aviators not even eligible to leave the service did not meet the original purpose of the 
program. Realizing this, the author concluded that the policy must change. Because she 
could not resolve whether it was the additional obligated service or the devaluation of 
ACP that matters to aviators, she chose to focus her study on what could be quantified. 
The study calculates required bonus amounts to meet department head requirements over 
the next few years and constructs an ACIP program that is compatible with current career 
paths and resources available. This study is an excellent case of quantifying what needed 
to be quantified but may have been more effective if it had resolved what was causing 
aviators to leave the service. 

The Navy is not the only service to actively study retention. All services are 
equally concerned about protecting significant investments in human capital. The Marine 


Corps has experienced many of the same problems in aviator retention that have been 
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discussed in this literature review. Aviator Retention in the Marine Corps (Kostiuk, 1989) 
provides an analysis of factors affecting retention of Marine aviators from 1977 through 
1988. These factors included military pay, civilian earnings, unemployment rates and 
civilian hiring trends. The study examines estimates of the impact of these factors and how 
they are used to predict the effect of changing policies on Marine aviator retention. It also 
calculates the potential effects of changes in ACIP and ACP programs. The analysis was 
conducted by creating a statistical model using retention rates for years 1977 through 
1988 broken out by military occupation specialty (MOS), years of commissioned service 
(YCS) and fiscal year as well as data on civilian employment opportunities, airline salaries 
and annual hiring rates. The study found that airline hiring, unemployment rates and the 
difference between military and civilian pay have a significant impact on retention. This 
study is similar to the approach taken in this thesis. 

All of these previous studies have provided insight into the variables that impact 
aviator retention. Another important issue is how retention statistics are measured. A 
report called Effectiveness of Alternative Officer Retention Measures Final Report 
(Mackin, 1996) studied various retention measures. It explored the most appropriate 
aggregate retention measures and the most effective way to provide and deliver retention 
information to BUPERS analysts and decision makers. The study compares alternative 
retention measures and evaluates their ability to predict officer retention patterns. The 
alternative measures it uses are spot continuation rates, MSR survival rates, and 


cumulative continuation rates. Each of these measures are calculated differently and are 
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used in different situations so it 1s difficult to say which method is the ‘best." Nonetheless, 
analysts must be able to choose which method to use depending on their specific problem. 
The method must be able to address the problem of eligibility to leave the service. 
Currently there is no end-of-obligated-service (EAOS) date for officers and although 
NPRDC developed an algorithm to predict this date, results of the calculations were less 
than satisfactory for econometric estimation purposes largely due to data entry problems. 
The only way to accurately determine whether an individual is under obligation is to 
evaluate service records on a case by case basis, which is an extremely timely process. 
Recommendations were made to include a data field in the officer master record (OMR) 
that indicates specific EAOS as well as the necessary processing logic for assignment 
officers to update the data as additional service 1s incurred. These recommendations would 
greatly simplify the study of retention as analysts would have access to valuable 
information that is currently relatively inaccessible. 

Finally, the study of Naval Aviator Cohort Survival Rates: Progress and Next 
Steps (Hogan, 1995) discusses progress made in separating the influence of policies 
affecting observed retention from the voluntary decisions of aviators. These decisions 
form the underlying voluntary survival rates that are of utmost concern to analysts. After 
resolving this difference, the author suggests directions for improvement in the future. 
Hogan examines MSR survival rates and cumulative continuation rates to create a simple 
spreadsheet model for aviation officer community managers to estimate future 


continuation rates as a function of military and civilian pay growth, ACP and VSI/SSB 
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policies, MSR and years of service, and a catch-all category for miscellaneous factors 
titled “other." This model is a valuable tool that planners should take advantage of in 
predicting retention behavior. This thesis will attempt to build on that model and analyze 


various institutional and non-institutional factors that may affect aviator retention. 
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IV. DATA AND METHODOLOGY 


This study uses a unique, pooled database created from various sources. The 
primary source was the 1997 Officer Personnel Information System (OPIS) which is an 
information summary system (ISS) for the Navy officer community managers and analysts. 
OPIS contains valuable historical information on officers including inventories, losses, 
promotions and retention arrayed by a variety of dimensions including designator, grade, 
commissioning source and gender. This information was created in a summarized form 
from Bureau of Navy Personnel Officer records through the Naval Personnel and 
Research and Development Center’s “FAIM-O” system. The data is accessed by 
Highlander ™ data query software. Other sources of data for this study are the Bureau of 
Labor Statistics and the Bureau of Naval Personnel Aviation Community Manager’s 
office. 

In accessing the 1997 version of OPIS (OPIS97), the database of “All Navy Less 
Warrants” was used because it included all commissioned U.S. Navy officers (less Warrant 
Officers) through 1996. This data contained both the USN and USNR pilots (designated 
131X) in every specific aviation sub-community. Within this subsystem, the “Retention” 
module was then used to extract continuation rate information for all pilots by year group, 
commissioning source, and aviation qualification designation (AQD). 

To determine the specific year group of pilots and group them by cohorts, the data 
had to be manually manipulated by converting the “Years of Service” (YOS) dimension 


into a commissioning year cohort. Currently the YOS dimension allows the user to select 
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any one combination of YOS from zero to 31 (where 31 denotes those with 30 or more) 
years of service. The Highlander |. 1™ software unfortunately does not allow the user to 
simply query the system by cohort at this time.2 This study analyzes the pilot cohorts from 
YG84 through YG89 and their continuation rate behavior between 1990 and 1996. 

The ‘Source” dimension provides information regarding officer commissioning 
source. This study focused on only three sources, which contain the majority of 
commissioning sources for all pilots. The three groups studied were U.S. Naval Academy, 
a combination of NROTC scholarship and college programs, and a combination of 
Aviation Officer Candidate School (AOCS) and the Aviation Reserve Officer Candidate 
(AVROC) programs. These three groups were separated to obtain variation in 
continuation results by commissioning source. Although each commissioning source is 
subject to a different initial MSR, after flight training, all pilots are grouped together and 
subject to the same MSR obligations. 

The ‘Designator” dimension allows the user to access information regarding the 
different aviation sub-communities. Table 4.1 presents a list of the communities studied 


and the platforms used in each. 


2 Future releases of the software will allow the user to create “macros” or formulas 
which will enable the user to refine his query to attain desired output. 
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Table 4.1 


Community Variables 


Variable Sub-Community 


VF - F14 


< 


VFA - F/A18, A7 
VA - A6 
VAQ VAQ - EA6 


V VS - 83 


| 


VQJ VQ - ES3 

od FLEET SUPPORT - JET 
O JET - OTHER 

TOTJ TOTAL - JET 

VAW VAW -E2 


VP - P3 


| 


VQP VQ - EP3 
FLEET SUPPORT - PROP 


PROP - OTHER 


ie 5 
eZ 


TOTP TOTAL - PROP 


HS2 HSL - SH2 


HS6 HSL - SH60B 


HS - H3/H60 


| 
Cp 


FSH FLEET SUPPORT HELICOPTER 


HCV HC - CH46 


LJ 







ALL 





UNKNOWN AQD 
Lees ra 


Continuation rates for each sub-community, by commissioning source and year 
group, were obtained for 1990 through 1996 and input into an EXCEL spreadsheet 
database. These continuation rates were computed as (1 -‘Strength loss rate’) for each 
given inventory at the beginning of a fiscal year. For example, suppose there were initially 
one hundred pilots in a specific community and there were 20 strength losses during the 
year. The continuation rate for that cell would be 80 percent (1 - 20/100). These ‘Strength 
losses” include reduction in active duty (RAD), resignations, retirements, reversion to 
enlisted status, death, discharge, and miscellaneous categories. The continuation rates 
used are summarized in the Appendix to this study and reflect similar results to Tables 
2.la through 2.1f when examining the ALL AQD which represents the entire pilot 
community. 

The EXCEL spreadsheet into which the continuation rate data is input also 
contains unemployment data, airline industry hiring data, a variable specifying the active 
duty service obligation (ADSO) of each cohort, and a variable specifying whether or not 


the specific sub-community or cohort was offered aviation continuation pay (ACP). 
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Unemployment data was provided for the past ten years by the Bureau of Labor 
Statistics. This information is obtained from the Current Population Survey. The data are 
seasonally adjusted and encompass the entire civilian labor force (16 years old and older). 
Monthly unemployment rates were summed and averaged to derive an annual 
unemployment rate. This annual unemployment rate was then matched to the years studied 
in this analysis (1990 through 1996) and input into the newly created database. Table 4.2 
presents a summary of the unemployment data used 1n this study. 


Table 4.2 


U.S. Unemployment Rate Data 





Total “Air Transportation Industry” employee data for the past ten years were also 
obtained from the Bureau of Labor Statistics. This information was used because it most 


closely approximates a similar civilian occupation for military pilots. That 1s not to say that 
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all aviators who leave the service look only to the commercial airline industry for 
employment, but it should be considered a viable option due to its similarity to military 
aviation careers. The statistical data were summarized by month, in thousands of 
employees in the entire industry. This provided a means to monitor growth in the industry 
by observing increasing or decreasing total numbers of employees. Although only monthly 
totals were provided, annual increases or decreases in the totals were derived by 
subtracting the total number of employees in January of one year from the total number of 
employees in January of the next year. In 1991, the total 1s negative which indicates a 
downsizing in the industry for that year. Table 4.3 summarizes the air transportation 
industry annual growth totals. 


Table 4.3 


Air Transportation Industry Growth (in Thousands) 
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The remaining data were obtained from the Bureau of Naval Personnel Aviation 
Officer Community Manager and from historical ACP qualification messages. A dummy 
variable representing the active duty service obligation (ADSO) policy was created for 
each cohort based on the ADSO policy associated with that particular year group and sub- 
community. In 1984 through 1986, the ADSO for all pilots was five years from the date of 
‘winging’ or completion of flight training. In 1987, the ADSO increased to six years for 
all pilots and in 1988, it increased to seven years for helicopter and propeller community 
pilots and eight years for jet pilots. These increases in ADSO lengthen pilots’ careers in 
order to protect the Navy’s investment in human capital made from flight training, but 
they also cause continuation rates to sometimes misrepresent actual continuation behavior. 
If a pilot is still serving under his ADSO, he is not eligible to leave the service and 
therefore, voluntary continuation cannot be assumed. This database associates ADSOs 
with their respective year groups and communities in an attempt to measure the impact 
these policy changes have on continuation behavior. It also includes a variable to indicate 
whether or not an individual is eligible to make the stay or leave decision by controlling 
for the fact that he is still under an MSR/ADSO policy or not. 

The next variables considered are dummy variables representing ACP eligibility. 
ACP policies are targeted to specific sub-communities and year groups to ensure there are 
enough officers to adequately fill department head billets. Acceptance of ACP obligates 


these officers through their fourteenth year of service in return for monetary 
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compensation. Although traditionally not all pilots in each targeted sub-community receive 
ACP, they are all technically eligible to request it. In some cases a review board is held to 
determine the ‘most qualified” individuals within that sub-community so that budgetary 
limitations will be satisfied. In other cases, individuals simply do not accept the ACP 
offered because the compensation benefits do not outweigh the psychological or economic 
costs associated with being obligated for an extended time period. This database classified 
those particular sub-communities and year groups as “eligible” or ‘hot eligible” for ACP in 
order to determine whether or not the specific ACP policies implemented between 1990 
and 1996 have a significant effect on continuation rates. 

Dummy variables were also created for each general sub-community (jet, propeller 
and helicopter) to control for the differences in continuation behavior between the 
different aircraft type pilots. Ideally, a study should consider the continuation behavior at 
the specific sub-community level but due to limitations of this model and problems 


associated with multicollinearity, this was not possible. 
Methodology 


The relationship between various institutional and non-institutional factors on 
aviator cohort continuation rates 1s specified by the following multivariate linear 
regression model: 

CR = BO + BI UNEMP + B2HIRES(t-1) + B3BONUS + B4JET + BSPROP + 


B6HELO + B7ADSOS5 + BBADSO6 + BOADSO7 + BIOADSOS8 + B1IMSR + U 
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where CR is the continuation rate for cells representing a specific AQD, year group and 


commissioning source. BO is the intercept term and B] - 11 represent the coefficients of 


the variables in the equation to be estimated. The equation is estimated using ordinary 


least squares. The independent variables are defined as follows: 


a lee 


UNEMP is the annual unemployment rate associated with the fiscal year being 


studied. 


. HIRES(t-1) is the growth in the air transportation industry, lagged by one 


year. It is lagged because that is the time frame during which aviators are 


making their stay or leave decision regarding their careers. 


. BONUS is a dummy variable representing the specific policies implemented 


between 1991 and 1996. It denotes whether or not a cohort with a given AQD 


was Offered aviation continuation pay (1=yes, 0=no) in a given fiscal year. 


. JET, PROP and HELO are dummy variables representing the three general 


aircraft type pilots (1=yes, O=no). Because every individual must be included in 
one of these three categories, one must be omitted from the model to 
determine the relative effectiveness controlling for aircraft type has on 
continuation rate behavior. The PROP category was arbitrarily omitted from 


this model and referenced as the “base case” for aircraft type. 


. ADSOS through ADSO8 are dummy variables representing the active duty 


service obligation policy (five through eight years from date of winging) 


associated with each particular cohort studied (1=yes, O=no). For example, an 
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ADSOS variable coded “1” indicates that that particular cohort has a five-year 
obligation from the date of winging. Because every individual must be subject 
to one of these ADSOs in the model, one ADSO variable is omitted to 
determine the relative effects of the different policies. During each model run, 
the ADSOS variable was omitted and the remaining ADSOs referenced from 
that variable. For models involving jet pilots, the ADSO7 variable was also 
omitted because jet pilots were never subject to a seven-year obligated service 
commitment. Likewise, the ADSO8 variable was omitted from the models 
involving helicopter and propeller pilots because they were never subject to an 
eight-year obligation. 

6. MSR is a dummy variable created to indicate whether or not an individual is 
eligible to leave the service or not (1=yes, 0=no) in a given fiscal year. For 
example, if M/SR=1, that particular individual is eligible to leave the service. 

7. The error term is represented by U. 

Table 4.4 provides a sample of the arithmetic means of each variable. It also 

provides the number of observations (N) of each variable and the standard deviations 


associated with the means. 
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Table 4.4 


Sample Variable Means 


BONUS91 0.0800000 0.2713363 
BONUS95 3150 0.0288889 0.1675208 


Variable Standard Deviation 








CR 


The expected or hypothesized relationship between the independent variables and 








the continuation rate is as follows: 
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ie 


UNEMP is hypothesized to have a positive effect on continuation rates. As 
total civilian unemployment rates increase, continuation rates should increase 
as more pilots stay in the military due to the lack of available civilian job 
Opportunities. This non-institutional factor is included because it is 
theoretically relevant to the entire pilot community. 

HIRES is a non-institutional factor hypothesized to have an inverse 
relationship with continuation rates. As the growth rate of the air 
transportation industry increases, the Navy pilot community should decrease as 
officers leave the service to seek civilian employment. 

The BONUS policies are institutional factors hypothesized to have a positive 
impact on continuation rates. As monetary compensation is offered to pilots to 
remain in the service, the gap between civilian and military earnings will 
become smaller causing military pilots to be more satisfied with their current 
status. 

The general aircraft type variables represent institutional factors that are 
hypothesized to affect continuation rates due to different opportunities for 
employment in the civilian sector. 

All of the ADSO variables are institutional factors hypothesized to have a 
positive impact on continuation rates because the policies enacted will increase 
the amount of time obligated from flight training. If the individual is not eligible 


to leave the service, continuation rates should increase. 
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6. The MSR variable is hypothesized to have a significantly negative effect on 
continuation rate behavior. If more officers are eligible to leave the service, 
continuation rates should decrease significantly. 

Because the MSR and ADSO variables are similar in measuring service obligations, 
the model must be executed twice; once with the MSR variable included and the ADSO 
variables omitted and once with the MSR variable omitted and the ADSO variables 
included. This eliminates the problem of bias in the estimators because they are both 
theoretically measuring different aspects of the same factor - - being under a service 
obligation. 

The model is also executed with the effect of eligibility to leave the service 
accounted for. This allows us to examine the true effects of these variables on the 


continuation rates of only those individuals eligible to leave the service. 
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V. STATISTICAL RESULTS 


Results of estimating OLS models are presented in Tables 5.1 through 5.3. These 
tables include the parameter estimate, standard error, and a t-value for the null hypothesis 
(t-value for HO). They also include measures of effectiveness for the model including R’ 
and F-value. The model R? measures the goodness-of-fit of the regression model by 
measuring the proportion of the total variation in dependent variable (CR) explained by 
the regression model. All of the models reveal a relatively low R* which is due to the fact 
that the model probably suffers from some degree of specification bias in that it has 
omitted some significant factors that determine retention behavior. Some of these factors 
are omitted because of the difficulty in quantifying certain variables such as “quality of 
life” concerns. The F-value of the model 1s a measure of the overall significance of the 
estimated regression. It tests the null hypothesis (HO) that each of the estimated 
coefficients are jointly equal to zero (Turner, 1995). For all of the models, the calculated 
F-value is statistically significant with a 99 percent confidence interval. This allows us to 
reject the null hypothesis and accept the fact that the estimated coefficients do not jointly 
equal zero, leading us to believe that despite the low R’ values, the models are effective in 
explaining the variation in continuation rates. 

The parameter estimates for the UNEMP, HIRES, BONUS and aircraft type are 
included in both tables. Based on the a priori hypothesized effects of each explanatory 
variable, a one-tail test of statistical significance is used to test the significance of the 


regression coefficients (Gujarati, 1995). A single asterisk (*) in the ‘PROB > |T | column 
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indicates statistical significance at a minimum of 90 percent. Two asterisks (**) indicate 
statistical significance at a 95 percent confidence interval. Three asterisks (***) indicate 
statistical significance at a 99 percent confidence interval, which is the highest level of 
significance observed. The absence of an asterisk indicates that the result was not 


statistically significant at any of the levels tested. 
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Table 5.1 


OLS Results Including the MSR Variable (Excluding ADSO) 
For All Pilots, Regardless of Eligibility to Leave the Service 


VARIABLE PARAMETER STANDARD T VALUE FOR PROB > |T 
ESTIMATE ERROR HO 
INTERCEPT 88.888 139 4.30372476 20.654 0.0001 


0.594842 0.61881673 0.961 0.3365 
-0.003454 0.01530122 -0.226 0.8214 
BONUS | 










JET 
8.677 


Reo 0507 
Sample Size (N) = 3150 
F-Value = 27.994*** 





Table 5.2 


OLS Results Including ADSO (Excluding MSR) 
For All Pilots, Regardless of Eligibility to Leave the Service 


AQD PARAMETER STANDARD T VALUE FOR PROB > |T 
ESTIMATE ERROR HO 


INTERCEPT 83.240413 4.35522786 19.113 0.0001 
















R’ = 0.0563 
Sample Size (N) = 3066 
F-Value = 22.810*** 
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Tabie 5.3 
OLS Results Restricted to Those Eligible to Leave the Service 


AQD PARAMETER STANDARD T VALUE FOR PROB > |T 
ESTIMATE ERROR HO 
















R* = 0.0268 
Sample Size (N) = 2100 
F-Walte = 1t7537>7* 

As in Kostiuk’s study of Aviator Retention in the Marine Corps (Kostiuk, 1989), 
the analysis of the statistical model shows that the impact of a change in a variable 
depends on the estimated parameter coefficient, the starting level continuation rate, and 
the size of the change in the variable. For a given change in the variable and a constant 
coefficient, the change in retention will be greater the closer the continuation rate is to 0.5. 
As continuation rates increase, the impact of any variable change diminishes. Kostiuk uses 
the example of expecting a change in pay to be less when continuation rates are already 
high because there are fewer people to be persuaded to stay by the increase in pay. This 
example can be applied to these models in that, on the whole, because the continuation 
rates used in this study are relatively high, we can expect the effects of different variables 
may be less than originally hypothesized. We can also expect more significant results to be 


produced by the model examining only those eligible to leave the service than those 


incorporating all pilots, regardless of their eligibility status. 
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A. UNEMPLOYMENT 


The unemployment variable is not a statistically significant factor in explaining 
continuation rates for pilots unless the “eligibility problem” is resolved. When the model 
was executed for only those individuals eligible to leave the service, the resultant estimate 
was Statistically significant with a 90 percent confidence interval. Although the relationship 
is not statistically significant for all pilots, regardless of eligibility, it is positive indicating 
that as the total unemployment rate increases, pilots are more likely to remain in the 
service, which is the hypothesized direction. For those eligible to leave the service, the 
relationship is inverse in that an increase in unemployment decreases continuation rates. 
This contradicts the original hypothesis, but may be attributable to the fact that the pilot 
community represents such a relatively small segment of total employment opportunities 
and their behavior is not representative of society on the whole. One possible problem 
with this variable is its highly aggregated nature. UNEMP only varies across years. This 


lack of variation may explain its poor performance. 
B. AIR TRANSPORTATION INDUSTRY HIRES 


For the air transportation industry hires variable, the estimates are again not 
Statistically significant at any confidence interval unless controlling for the eligibility 
problem. When the model is executed for only those eligible to leave the service, the 
relationship is significant with a 90 percent confidence interval. The relationship that exists 
is in all models inverse in that a decrease in air transportation industry hiring rates induces 


a slight increase in continuation rates. This supports the original hypothesis that the 
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growth of the industry should produce decreased continuation rates. Unfortunately, the 
same problem of aggregation level affects H/RES that affects UNEMP which leads to a 


probable bias in the estimates. 
C. BONUS 


The BONUS variable provides unexpected results. Statistically significant results 
are obtained in each model with a 99 percent confidence interval. This result reveals an 
inverse relationship between continuation rates and ACP policies which indicates that an 
increase in the possibility of a bonus being offered decreases continuation rates. Although 
specification bias was previously discussed, this result remains counter-intuitive. One 
would hypothesize that an increase in bonus availability would lead to higher rather than 
lower continuation rates. This opposite result may be attributable to the fact that bonuses 
are targeted at sub-communities with predicted retention problems. This causes a 
simultaneity bias in the estimate as it 1s attempting to predict the effect the bonus has while 
simultaneously solving the retention problem. To compensate for this bias, a Two-Stage 
Least Squares model was constructed where in the first stage, BONUS is estimated as a 
function of all exogenous variables analyzed (UNEMP, HIRES, JET, PROP, and HELO). 
In the second stage, the dependent variable is estimated as a function of the BONUS 
estimate from the first stage. The advantage of this method is that it eliminates the 
simultaneity bias in the coefficient of the bonus. Tables 5.4 through 5.6 present the results 
of this model. In the second stage results we can now see that the effect of the bonus on 


retention 1s now positive, although it is not statistically significant. Table 5.7 presents the 
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Table 5.4 
Two-Stage Least Squares - First Stage Results 
Using Continuation Rate as the Dependent Variable 


ESTIMATE ERROR HO 


7 | 
[ES al 














-4.502519 1.332472 -3.379 0.0007*** 
HELO 4.071867 1.163077 3.501 0.0005*** 


R? = 0.0254 
Sample Size (N) = 2100 
F-Value = 10.927*** 


Table 5.5 
Two-Stage Least Squares - First Stage Results 
Using BONUS as the Dependent Variable 


ESTIMATE ERROR HO 
HELO 








R* = 0.0897 
Sample Size (N) = 2100 
F-Value = 41.244*** 
Table 5.6 
Two-Stage Least Squares - Second Stage Results 
Using Continuation Rate as the Dependent Variable 


ESTIMATE ERROR HO 
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Table 5.7 
Two-Stage Least Squares - First Stage Results 
Using JET, PROP, and HELO to Identify BONUS 


VARIABLE PARAMETER STANDARD T VALUE FOR PROB > |T 
ESTIMATE ERROR HO 










R? = 0.0021 
Sample Size (N) = 2100 
F-Value = 1.494 
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results of the model when using JET, PROP, and HELO to identify BONUS. This 
suggests that simultaneity bias is a problem and that more variables are required to 
properly identify the model. 

Another possible explanation for these unexpected results is related to the fact that 
the intent of the bonus program is to compensate for low retention by offering monetary 
incentives to remain in the service. The monetary compensation associated with the ACP 
policies had not been updated since 1989 and has thus become undervalued by 
approximately 38 percent (Moore, 1997). Recently the compensation has been increased 
to a maximum of $25,000 to rectify this matter. In this analysis, results may indicate that 
previous policies have not been as successful as hoped. However, note that this variable is 
also highly aggregated and subject to different types of bias. The BONUS variable equals 
“1” for the entire fiscal year during which a bonus may have been available to a targeted 


community. This indicates that every pilot in that year group was technically eligible for 
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ACP while only a select few individuals may have accepted it. Because of this, these 
preliminary results must be viewed as inconclusive in actually estimating the true impact of 
ACP on retention. Factoring in the simultaneity bias that precludes discerning the true 
impact of the variable on continuation rates with the quality of the data forces us to 


examine this estimate with skepticism. 
D. ADSO6 


The ADSO6 policy variable is statistically significant at the 99 percent confidence 
interval when referenced to the ADSO5 policy variable. The relationship between this 
estimate and continuation rates is positive, corresponding with the onginal hypothesis that 
the variable would have a positive effect on pilot continuation rates. 


E. ADSO7 


This policy variable also reveals statistically significant results at a 99 percent 
confidence interval. The estimate reveals a positive relationship between continuation rates 
and the policy enacted in 1987 of increasing the ADSO from six to seven years for 
helicopter and propeller pilots. This reaffirms the initial hypothesis that increasing required 
obligated service would serve to increase continuation rates. 


F. ADSO8 


Like the ADSO6 and ADSO7 variables, this policy variable provides a statistically 
significant parameter estimate. This estimate is also positive indicating that the increase in 
obligated service has a positive effect on increasing continuation rates for jet pilots 


because they were the only pilots subject to this policy. 
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G. JET, PROP AND HELO 


The specific aircraft type variables reveal statistically significant estimates at a 99 
percent confidence interval when controlling for MSR and not including the ADSO 
variables. When the ADSO variables are included, there is still a significant relationship 
between aircraft type and continuation rates but for the JET community that confidence 
interval is reduced to 95 percent, as compared to the PROP community. These estimates 
are nonetheless positive in both models, indicating that the specific community ongin 
positively impacts continuation rate behavior, although more so for helicopter pilots than 
for jet pilots when referenced to propeller pilots. 


H. MSR 


The MSR coefficient indicates that whether or not an individual is eligible to make 
the stay or leave decision is statistically significant at a 99 percent confidence interval. This 
relationship is inverse, confirming the orginal hypothesis that continuation rates should 
decrease once an individual is no longer subject to any form of obligated service and is 
eligible to leave the service. When the model is executed for only those individuals eligible 
to leave the service, each variable reveals statistically significant estimates for every 


variable. This 
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VI. CONCLUSIONS AND RECOMMENDATIONS 


This thesis examines the relationship between various institutional and non- 
institutional factors that affect Naval aviator retention and the continuation rates of pilots 
in year groups 1984 through 1989. A unique, pooled database was created that will allow 
future analysts to further study aviator retention rates. The specific factors analyzed are 
unemployment rates, air transportation industry hiring data, ACP policies implemented 
between 1991 and 1996, and various MSR policies affecting pilots’ active duty service 
obligation. The continuation rates, computed by sub-community, year group and 
commissioning source, are examined for 1990 through 1996 to determine the effect of 
various factors on the retention behavior of pilots. 

The analysis found a statistically significant relationship between the offering of a 
bonus and continuation rates. Unfortunately this analysis must be viewed with skepticism 
due to significant problems with the model and data specification. The relationship 
revealed is inverse in that the offering of a bonus is associated with lower pilot 
continuation rates. This is difficult to accept as true due to the intuitive theory that if we 
pay someone enough money, they will remain in the service. The results obtained may be 
correlated to the fact that bonuses are targeted towards communities with historically 
unsatisfactory continuation rates and to problems associated with the statistical analysis 
previously discussed. A possible inference from this result, if it were true, is that bonuses 
are currently being offered to individuals who would most likely remain in the service 


without a bonus or that the bonus is not a significant enough factor alone to affect 
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individuals considering whether or not to leave the service. From these results however, 
we can not conclude with any degree of confidence that the ACP structure pertaining to 
this study was relatively effective or ineffective in impacting continuation rates. It is 
important to note that the ACP program has recently been updated by increasing the 
monetary compensation available to eligible aviators. This change may remedy some of the 
ineffectiveness of the prior program and actually serve to increase continuation rates, thus 
satisfying the intent of the program. Previous studies have proven the effectiveness of 
incentive programs in increasing retention. Considering the updated ACP program and 
resolving problems with the statistical analysis should allow analysts to refine their studies 
of continuation behavior and determine the true impact bonuses have on retention. 

Both the unemployment and air transportation industry hiring rates provide 
Statistical significance in explaining pilot continuation rates only when examining the pilots 
eligible to leave the service. These variables reveal negative relationships with continuation 
rates indicating that an increase in unemployment rates and airline hiring rates actually 
decreases continuation rate behavior. Prior studies, including Kostiuk’s Marine Corps 
study, have indicated that unemployment and civilian airline hiring have had significant 
effects on aviator retention. The differences in this study and those prior studies is most 
likely attributable to the fact that as continuation rates increase, the impact of any variable 
change diminishes. The continuation rates used were generally high, which leads us to 
expect these variables to exhibit less of an effect on continuation rates than intuitively 


expected. The unexpectedly negative relationship between continuation rates and 
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unemployment rates may be attributed to the relative insignificance the pilot community 
has in impacting total unemployment rates. This possibility should be examined in future 
studies. 

The lack of statistical significance for the unemployment and air transportation 
industry hires estimates when not isolating the model to include only those eligible to 
leave indicates that these variables have no significant impact on overall pilot continuation 
rates unless they are eligible to leave. This supports that aviators are relatively insensitive 
to changes in the non-institutional environment affecting them, and rejects the theory that 
aviators are more likely to leave the service when the airline industry is hiring pilots at 
increased rates. This result is probably due to the fact that only a relatively small 
percentage of aviators leaving the service actually seek employment in the airline industry 
and the data used in this study is of a highly aggregated nature leading to possible bias in 
the statistical analysis. 

Results from the analysis of changing ADSO policies support the original 
hypothesis that increasing obligated service commitments will tend to increase 
continuation rates. The increase of obligated service lengths from five to six, seven and 
eight years has become more statistically significant as the length of service increases. 
Referenced to the five-year ADSO policy, the six-year ADSO policy implemented in 1987 
and the seven and eight-year ADSO policy implemented in 1988 for all pilots are all 
Statistically significant at a 99 percent confidence interval indicating that the policies have 


been effective in increasing desired continuation rates. 


So 


The MSR variable estimate also confirms that individuals eligible to leave the 
service are much more likely to leave than those not eligible. The estimate is negative and 
Statistically significant at a 99 percent confidence interval proving the original hypothesis 
and indirectly reaffirming the fact that MSR policies do effectively induce higher 
continuation rates. 

These results may be considered trivial because the individuals concerned are 
legally bound to stay in the service therefore revealing significant effects. Restricting the 
model to study only those eligible to leave eliminates some of the bias and allows analysts 
to focus their study on true continuation rate behavior. The results from the model 
examining only the individuals eligible to leave reaffirms this point by revealing more 


Statistically significant results than the models not controlling for the eligibility problem. 
Summary and Recommendations 


This study suggests that the institutional factors analyzed have had a greater 
impact on Naval aviator continuation rates than the non-institutional factors. Increases in 
obligated service requirements have probably caused continuation rates to be unexpectedly 
high as individuals are not eligible to make a stay or leave decision until later in their 
careers. There is also a bias evident in this study due to the fact that the data file is based 
on pooled, aggregate data and cannot be applied to every individual. This problem could 
be rectified by including a reliable variable in the Officer Master File that would allow 
analysts to monitor and examine eligibility and predict retention behavior on an individual 


basis. Once this eligibility problem is resolved on an individual level and the aggregation 
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bias is reduced, a clearer understanding of factors affecting aviator retention will be 
possible. On an individual level, the specific reasons for leaving the service could also be 
analyzed. Currently the database does not discriminate between various reasons for 
leaving the service, it only considers overall ‘Strength losses’. With a _ greater 
understanding of the reasons for leaving the service, analysts will be better able to predict 
retention behavior. Until then, decision makers should continue to exercise their influence 
in the form of policy guidance to ensure adequate retention rates are maintained and the 
investment in human capital made to train pilots is protected. 

With regard to the ACP program, inadequacies of this study have been addressed 
and future studies should examine the impact of the revised program on pilot retention to 
determine its effectiveness. 

Future studies should also examine the impact of military-civilian pay differentials 
as possible causes for retention behavior to increase or decrease. An annualized cost of 
leaving (ACOL) model could be used to measure the perceived and actual differences in 
earnings between the civilian and military pay structures. The earnings figures would have 
to be annualized or summarized to include expected future earnings because if only 
Starting salaries are considered, results would lead analysts to conclude that the lower 
salaries in the airline industry may actually induce lower continuation rates. This is due to 
the fact that historically, military pilots would be forced to accept a reduction in earnings if 


hired by the airline industry. Once the future earnings (which traditionally have been 


Syl 


significantly higher for the civilian sector) are factored in, the results would become much 


more intuitively believable. 
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APPENDIX: CONTINUATION RATE DATA 
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